Goto

Collaborating Authors

 Lyme Regis


A Tale of Two Languages: Large-Vocabulary Continuous Sign Language Recognition from Spoken Language Supervision

Raude, Charles, Prajwal, K R, Momeni, Liliane, Bull, Hannah, Albanie, Samuel, Zisserman, Andrew, Varol, Gül

arXiv.org Artificial Intelligence

In this work, our goals are two fold: large-vocabulary continuous sign language recognition (CSLR), and sign language retrieval. To this end, we introduce a multi-task Transformer model, CSLR2, that is able to ingest a signing sequence and output in a joint embedding space between signed language and spoken language text. To enable CSLR evaluation in the large-vocabulary setting, we introduce new dataset annotations that have been manually collected. These provide continuous sign-level annotations for six hours of test videos, and will be made publicly available. We demonstrate that by a careful choice of loss functions, training the model for both the CSLR and retrieval tasks is mutually beneficial in terms of performance -- retrieval improves CSLR performance by providing context, while CSLR improves retrieval with more fine-grained supervision. We further show the benefits of leveraging weak and noisy supervision from large-vocabulary datasets such as BOBSL, namely sign-level pseudo-labels, and English subtitles. Our model significantly outperforms the previous state of the art on both tasks.


Distinguishing the Knowable from the Unknowable with Language Models

Ahdritz, Gustaf, Qin, Tian, Vyas, Nikhil, Barak, Boaz, Edelman, Benjamin L.

arXiv.org Artificial Intelligence

We study the feasibility of identifying epistemic uncertainty (reflecting a lack of knowledge), as opposed to aleatoric uncertainty (reflecting entropy in the underlying distribution), in the outputs of large language models (LLMs) over free-form text. In the absence of ground-truth probabilities, we explore a setting where, in order to (approximately) disentangle a given LLM's uncertainty, a significantly larger model stands in as a proxy for the ground truth. We show that small linear probes trained on the embeddings of frozen, pretrained models accurately predict when larger models will be more confident at the token level and that probes trained on one text domain generalize to others. Going further, we propose a fully unsupervised method that achieves non-trivial accuracy on the same task. Taken together, we interpret these results as evidence that LLMs naturally contain internal representations of different types of uncertainty that could potentially be leveraged to devise more informative indicators of model confidence in diverse practical settings.


News at a glance

Science

SCI COMMUN SCIENTISTS' TERM LIMITS The Trump administration moved to impose 5-year term limits on top scientists at the U.S. Department of Health and Human Services (HHS). The rule, released on 15 January, requires that directors of seven centers at the Food and Drug Administration, as well as 17 positions at the Centers for Disease Control and Prevention, undergo a performance review that could lead to a new 5-year appointment, or to the staffer's transfer. A 2016 law mandates such 5-year reviews for institute and center directors at the National Institutes of Health. But some current and former officials worry the term limits will subject such positions to political interference from the White House, and they could face legal challenges, Politico reported. GLOBAL WARMING A surprise Environmental Protection Agency (EPA) rule finalized last week would effectively ban the government from regulating greenhouse gas emissions from heavy industries other than power plants. The agency substantially rewrote a draft rule originally focused on regulating carbon emissions from new power plants, expanding it to exempt other “stationary” sources, such as refineries and oil and gas wells. The exemption covers an entire class of sources if its collective emissions are less than 3% of the U.S. total. Only power plants, which produce 27% of U.S. carbon emissions, exceed that bar. Analysts say the rule is vulnerable to a court challenge, and the Biden administration can likely suspend its implementation. SPOTTED OWLS The U.S. Fish and Wildlife Service slashed protections for the endangered northern spotted owl on 13 January, declaring more than 1.4 million hectares of Pacific Northwest forests would no longer be considered critical habitat for the bird. The decision comes despite findings by agency scientists that the owl's population is declining and that it warrants stricter protection. The habitat reduction is part of a move by the outgoing Trump administration to settle a lawsuit by the timber industry and counties that earn revenue from logging. The land area is 17 times the amount that the agency initially proposed to remove from protections in August 2020. TRANSGENIC ANIMALS A push by the White House would essentially eliminate the Food and Drug Administration's (FDA's) authority to regulate genetically modified animals and put the U.S. Department of Agriculture (USDA) in charge. The two agencies had been negotiating on dividing the task, and critics of the White House move say it would put USDA in the problematic position of both promoting and regulating genetically modified animals. FDA opposes the shift, Politico reported. ARCTIC OIL DRILLING The first-ever auction of oil drilling rights inside the Arctic National Wildlife Refuge in Alaska, a policy priority for the Trump administration, met with a tepid response this month. Just three bidders paid $14.4 million to claim 11 parcels covering 220,000 hectares—about half of the land up for auction. In an unusual move, a state agency, the Alaska Industrial Development and Export Authority, won bids for nine of the parcels. It joined the auction in part because the agency fears the Biden administration will slow or block further leasing, reducing the state's potential economic gains. The leases must still be finalized by the Bureau of Land Management. Wildlife scientists have warned that the drilling could harm caribou herds and other parts of the ecosystem. FETAL TISSUE RESEARCH Scientists who use fetal tissue obtained from elective abortions would need to comply with new rules under a proposal released by the Trump administration on 13 January. Among other changes, the policy would add new requirements to forms used to obtain informed consent from women who donate tissue for research. It would also limit the source of fetal tissue, which often comes from nonprofit clinics, to federally or state funded hospitals or academic medical centers. In 2019, Trump's administration banned fetal tissue research by federal researchers and required a new ethics review for studies by scientists receiving federal grants; research groups have urged the Biden administration to reverse that policy. The new proposal, which is open for comment for 30 days, is not expected to move forward. CENSUS FIGHT The Trump administration last week abandoned a 2-year effort to prod the Census Bureau to provide a separate tally of undocumented U.S. residents as part of the 2020 census. In 2019, the president had ordered that the separate tally, and a rushed compilation of the decennial head count used for apportioning the 435 seats of the U.S. House of Representatives, be delivered before he left office. Most demographers said it could not be done and called the directive political interference. On 11 January, U.S. government lawyers told a federal judge that the apportionment numbers would not be ready until 6 March. Civil rights organizations want Census Director Steven Dillingham to resign before his term ends in December, saying he has failed to uphold the agency's high standards for data quality. ### Leadership President Joe Biden on 15 January named Eric Lander to be his science adviser and director of the White House Office of Science and Technology Policy. A mathematician turned molecular biologist, the 63-year-old Lander will take leave from his post as president and founding director of the Broad Institute, jointly run by Harvard University and the Massachusetts Institute of Technology (MIT). The first biologist to hold the job, Lander spent 8 years as co-chair of the nation's top science advisory panel under former President Barack Obama. He also co-led the public Human Genome Project, which completed its first draft in 2001. Biden has picked chemistry Nobel laureate Frances Arnold and MIT's Maria Zuber to lead his science advisory panel. He named David Kessler, a former commissioner of the U.S. Food and Drug Administration, to direct Operation Warp Speed, the federal effort to speed development of COVID-19 vaccines. And Biden said Francis Collins has agreed to remain as director of the National Institutes of Health. ### Conservation To study one of Europe's rarest butterflies, researchers pioneered a new method of observation: rappelling down vertiginous mountainsides along the border of Italy and Switzerland. Scientists first described the orange-and-brown Raetzer's ringlet ( Erebia christi ) more than 100 years ago, but its dangerous, inaccessible habitat complicated population surveys. Drawing on decades of climbing experience, independent biologists Andrea Battisti and Matteo Gabaglio slid down ropes to count butterflies in several areas during the past 6 years. It was “like being an explorer … going where nobody has ever [gone],” Gabaglio says. Researchers sighted the ringlet 177 times at two key sites in Italy, they reported this month in the Journal of Insect Conservation . That's good news, they add: The ringlet appears to be more abundant that previous studies suggested. But because of climate change and other threats, they recommend reclassifying the species as endangered rather than vulnerable. ### Policy President Joe Biden announced a sweeping, $400 billion plan last week to tackle the “dismal failure” of the COVID-19 vaccine rollout, safely reopen schools by March, and ramp up testing people for the pandemic coronavirus. The measures are part of an ambitious, $1.9 billion “American Rescue Plan” unveiled by Biden ahead of his inauguration to help people who are struggling financially because of the pandemic—a proposal that depends on Congress providing the money. The federal government would pay for 100,000 new public health workers to assist states in vaccination and other pandemic response efforts. Biden promised to invoke the Defense Production Act to provide vaccinemakers with whatever they need to increase production. Biden's administration would also work more closely with pharmacies to move vaccines from freezers into arms. “The more people we vaccinate and the faster we do it, the sooner we can put this pandemic behind us,” Biden said. ### Infectious diseases All eight gorillas at the San Diego Zoo Safari Park were exposed to the coronavirus that causes COVID-19, and at least two have begun to cough, zoo officials said last week. Tests of fecal samples showed that two were infected, marking the first known cases in nonhuman apes. The officials suspect the western lowland gorillas caught the virus from an asymptomatic staff member who tested positive for SARS-CoV-2; the zoo has been closed to the public for weeks because of the pandemic. The news confirmed fears that the virus can infect endangered great apes. Human respiratory viruses are already a leading cause of death for chimpanzees in the wild. ### COVID-19 High virus levels in saliva are correlated with later hospitalization, serious illness, or death from COVID-19, raising the prospect that testing saliva for the coronavirus that causes the disease will help identify patients most at risk, a study has found. The standard test to detect the SARS-CoV-2 virus analyzes samples of nasal mucus taken with nasopharyngeal (NP) swabs. But patients with the worst outcomes were more likely to have high virus loads in their saliva, but not in their NP swabs, report Akiko Iwasaki of Yale University and colleagues in a 10 January preprint. That may reflect that nasal mucus comes from the upper respiratory tract, whereas severe disease is associated with damage deep in the lungs; coughing regularly brings up viral particles to the throat, where they can pervade saliva. If the results are confirmed, saliva tests could help doctors prioritize which patients in the early stages of the disease should receive medicines that drive down levels of the virus. ### Planetary science The Red Planet has claimed another robot. Scientists at NASA and the German Aerospace Center last week called off a 2-year effort to rescue the failed rod-shaped heat probe, or “mole,” of the InSight lander. The mole was designed to burrow 5 meters into the martian soil and tease out how quickly heat escapes from Mars—a clue to how the planet formed. But soil compacted instead of crumbling as the rod tried to dig in, leaving it stuck at the surface. Even after engineers used InSight's robotic arm to push the probe down and scraped dirt on top, the probe failed a final attempt this month to dig on its own, leaving the mole buried in a shallow grave. InSight's other primary instrument, a seismometer, continues to function normally. ### Foreign influences The U.S. Department of Justice (DOJ) has added another prominent scientist to its crackdown on U.S.-based academics with allegedly undisclosed ties to China. On 14 January, police arrested nanotechnologist Gang Chen of the Massachusetts Institute of Technology (MIT) at his Cambridge home, charging him with violating federal wire fraud, banking, and tax laws. DOJ alleges Chen held various appointments with Chinese institutions and provided technical advice, “often in exchange for financial compensation and awards.” He allegedly failed to disclose these affiliations as required when applying for U.S. Department of Energy grants, and did not tell tax authorities about a bank account in China. MIT said, “We take seriously concerns about improper influence in U.S. research.” Chen was born in China and is a naturalized U.S. citizen. He is a member of the National Academy of Engineering and fellow of AAAS (which publishes Science ). ### History of science Fans of Mary Anning are hoping to raise £33,000 by next month to fund a statue honoring the paleontological pioneer, who discovered and interpreted key fossils along England's Jurassic Coast. Anning, who lived in Lyme Regis in the early 1800s, was the first to correctly identify an ichthyosaur, and discovered England's first pterosaur. Her discoveries were profoundly influential, but as a self-taught, working-class woman she was excluded from meetings of the Geological Society of London. Its members discussed and built on her discoveries, but often failed to acknowledge her. The £100,000 statue project was inspired by 13-year-old local Evie Swire. Organizers hope the cause will be helped by the film Ammonite , starring Kate Winslet as Anning, which opened in U.S. theaters in November 2020. ### Publishing AAAS, which publishes the Science family of journals, said last week it will offer its authors a free way to comply with funder requirements that their papers be open access on publication. Under a new policy, authors may deposit near-final, peer-reviewed versions of papers accepted by paywalled Science titles in public repositories where they are free to read. This “green open-access” route will apply for now only to authors of papers funded by Coalition S, a group of mostly European funders and foundations behind a mandate for immediate open access that takes effect this month. AAAS said it will pilot the new policy for 1 year.


The Origin of Poop: AI to Predict Source of Ancient Feces

#artificialintelligence

Archaeologists have applied the principals of AI to distinguish between ancient human and dog poo, cleaning up a storm of scientific confusion over the matter. Looking deep into the future, in October 2019 Elon Musk posted a tweet using Starlink, a satellite constellation of thousands of orbiting mirrors constructed by his American company SpaceX, to provide satellite Internet access everywhere in the world. What's more, Amazon continue to apply advanced AI programs to predict what you and I might buy next; but looking backwards in time, archaeologists have now use artificial intelligence to distinguish whether a sample of ancient poo has human or canine origins. In a New Scientist article, Maxime Borry of the Max Planck Institute for the Science of Human History in Germany discusses his new paper, which says ancient poo, or " coprolites", provides a valuable source of information about the identity, diet, and health of people who lived thousands of years ago. But the researcher explained that dogs lived alongside ancient hunters and canine feces are also commonly found at archaeological sites, "It is challenging to tell them apart," said Dr. Borry.


'My fingers were almost cut off by a drone'

BBC News

WARNING - GRAPHIC CONTENT: You may find some of these images distressing. When James Andrews' friend invited him over to the beach earlier this month to try out his drone, it appeared to be any regular Saturday. It was James' first experience with the small unmanned aircraft but it ended in disaster, nearly blinding him and leaving him with serious injuries. "It all happened so quickly. I didn't realise what it could actually do," James, 43, told the BBC.